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ABSTRACT 



Methods of generating and properties of Walsh functions 
are discussed with emphasis pn discrete Walsh functions* 
Hardware and software versions of two methods of Walsh func- 
tion generation are shown* The Walsh transform is explored 
and hardware and software realizations of a fast Walsh trans- 
form algorithm, particularly applicable to hardware, is in- 
troduced. Computer programs containing the various algo- 
rithms are included. A discussion of the feasibility of the 
use of Walsh functions to produce a digital filter with a 
desired frequency response is presented. 
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I . HISTORICAL BACKGROUND AND SCOPE OF THESIS 

A pair of functions are said to be orthogonal if the in- 
tegral of the product of those functions over all space 
vanishes. Systems of orthogonal functions have been avail- 
able for many years. At the beginning of the twentieth cen- 
tury, there were many well known and useful orthogonal 
functions: the trigonometric functions which occur in Fourier 

series; orthogonal polynomials such as those of Legendre, 
Hermite, and LaGuerre; Bessel’s functions; the S t urm-Lioville 
series; and other special functions. The general theory in- 
cluding all such systems of functions was essentially devel- 
oped prior to 1910 and it was shown that a set of such 
functions is by no means exceptional but can be produced at 
will . 

Alfred Harr [Ref. 10] formulated an orthogonal system of 
functions in 1909 (now called the Harr functions)- which 
essentially take on only two values. An exemplary set of 
Harr functions is shown in Figure 1. A formal expansion of 
an arbitrary continuous function in terms of Harr functions 
converges uniformly to the given function. This combination 
of convergence and bi-valued properties had not been pos- 
sessed by any other orthogonal set known to that time. 

Independently, and at about the same time in early 1922, 

H. Rademacher [Ref. 20] and J.L. Walsh [Ref. 24j, each exhi- 
bited a set of orthogonal functions taking on the values + 1 
on the interval [0,1]. The Rademacher set, [Figure 2], was 
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not complete as other non-trivial functions exist which are 
orthogonal to all of the members of the set. The Walsh 
functions, {Figure 3J , are a complete set and exhibit similar^ 
ities to the trigonometric functions in many of their proper- 
ties. The Walsh functions are discussed in detail in the . 
remainder of this thesis. 

Very little work was done with these various sets of bi- 
valued functions until the digital computer became a useful 
tool of the scientific community. Because of the dual value 
characteristics of the Harr, Rademacher, and Walsh functions, 
the applicability to the binary configured machines seemed 
natural. A substantial amount of effort has been directed 
into application areas during the past several years and pro- 
gress has been made in many fields which in ’ the past have 
only been associated with trigonometric functions. Some of 
the Walsh function application areas of interest include: 
multiplexing, pattern recognition, image processing, electro- 
magnetic radiation, and digital filtering. This paper will 
primarily discuss the area of digital filtering although many 
of the results are applicable to other areas of interest. 

Previously, analysis of digital filters and implementa- 
tion has been restricted to Laplace and Fourier methods and 
hence to trigonometric relationships. The implementation of 
a digital filter based on Walsh functions offers definite 
advantages unique to a two valued function but also has dis- 
tinct disadvantages inherent in the use of a set of discon- 
tinuous functions to describe a continuous function. Efforts 
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expended thus far in the area of VJalsh function digital 
filtering appear to be primarily concerned with obtaining 
the expansion of a given function in terms of the Walsh 
functions and the recombination of the weighted Walsh func- 
tions to obtain the filtered and reconstituted function. In 
this thesis the manipulation of the Walsh function represen- 
tation of the given function will be treated and compared to 
standard Fourier methods. It will be shown that in general 
there is no advantage to using Walsh functions for digital 
filtering when a specific frequency response is desired, but 
that for certain frequency responses, Walsh functions do 
give a decided advantage over the Fourier methods. 

Section II presents some of the properties of Walsh func- 
tions including a modified notation method v/hich, it is 
believed, is clearer and easier to use in mathematical re- 
lationships , 

Sections III and IV show methods of Walsh function gen- 
eration and Walsh transform techniques respectively. Algo- 
rithms are presented which are adaptable to either hardware 
or software and will either generate a set of Walsh functions 
or will take the Walsh transform of a given function. Serial 
or parallel input of a sampled function is provided for. 

Section V considers the use of Walsh functions to produce 
a digital filter with a desired frequency response. The fre- 
quency spectrum of discrete Walsh functions is derived, and 
it is shown that in general it is as complex to combine these 
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to achteve a desired frequency spectrum output as is the 
case in the Fourier domain. 
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H. PROPERTIES OF WALSH FUNCTIONS 



Walsh functions can be defined over the interval 10,1], 



in the following manner: 



V(0,t) 



rl, O^t^l 

^0, otherwise 



W(2k+p,t) = W(k, 2t) + (-l)^'*‘^W(k,2t-l) 



p = 0,1 ■ 

k = 0,1,2... 



(XI-1) 



When Walsh functions are used for digital filtering, the 
input function is normally sampled at some rate as are the 

Walsh functions. In order to discriminate between the dis- 

crete (sampled) and the continuous functions and for ease in 
mathematical manipulation, the following notation is used: 
Continuous function notation: 

W(k, t) 

k = 0,1,2,... index of Walsh function 

O^t^l independent variable 

Discrete function notation: 



W^(k, j) 

k = 0,1,2,..., N-1 index of Wash function 
N = a power of 2 order of set of Walsh functions 
j = 0,lj2,..., N-1 independent variable 
The discrete Walsk functions are formed from the contin- 
uous functions by sampling WCh,t) at t = (j/N)"*", Ci • e . , from 
the right) . Figure 4 shows the set of order 16 discrete 
Walsh functions arranged as a 16 x 16 matrix. 
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Several other forms of notation have been used for Walsh 



functions . 


Some of the 


most common 


of these are 


tabulated 


Table 1 for 


comparison 


and cross reference purposes. 


Discrete 
j=0,l. . ,N-1 


Continuous 

04t^l 


Walsh 
O^t^l 
iRef .24] 


Corr ington 
06t^l 
[Ref. 7] 


Harmu th 

- 

2 2 
[Ref. 9] 


Wg(0,j) 


w(0,t) 






Cal (0,6) 


Wg(l, j) 


w(l,t) 


■(>1 (t) 




Sal(l,0) 


Wg(2, j) 


W(2,t) 




'^011 


Cal (1,0) 


Wg(3, j) 


W(3,t) 






Sal(2 , 6) 


Wg(4, j) 


W(A ,t) 


4 'jht) 




Cal(2,6) 


Wg(5,j) 


W(5 , t) 




^lll(t) 


Sal(3, 0) 


Wg(6,j) 


W(6,t) 






Cal (3 , 6) 


Wg(7, j) 


W(7,t) 






Sal(4,6) 



Table 1. Notations for Walsh Functions 



These functions form a complete, orthonormal set over 

the interval [0,1]. The implication of this property is that 

any absolutely integrable function defined over the interval 

can be expanded in a series of Walsh functions analogous to 

the Fourier expansion of such a function. 

That is ; N--1 

f(t) = Z a,W(k,t) (II-2) 

k=0 

where : 

1 

a, = / fCt) WCk,t) dt ClI-3) 

0 

Assuming f(jT) is a sampled representation of fCt), 
where the sample period, T 1/N; then a, = 0 for 
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k ^ N and equations (II-2) and (II-3) reduce to: 



and 



N-1 

f(jT) = H a, \C(k,j) ClI-4) 

j=0 ^ ” 

N-1 

a, = 1/N Z f(jT) W (k,j) (II-5) 

j=0 " 



If the function f(t) or f(jT) is defined over the inter- 
val [0,T], a simple change of scale, t^ = t/T will allow the 
use of the above equations to find the Walsh representation 
of the function over [0,1], 

Sequency is defined as one-half the number of zero cross- 
ings per unit time. The number of zero crossings and hence 
the sequency of a given Walsh function can be obtained by: 



z = 



k+C-l) 



k+1 



(II-6) 



where z is the sequency 

and k is the index of the 
Walsh function 

The set, {a. }, therefore represents the sequency spectrum 

tC 

of f(t) in the same sense that a set of Fourier coefficients 
represents a frequency spectrum. It should be noted that 
the Walsh functions defined in this thesis are ordered ac- 
cording to increasing sequency. This is the definition as 
used by Walsh in his original paper [Ref.24J and is equiva- 
lent to that used by HarmutK iRef. 9J . Another method of 
defining Walsh functions is as products of Rademacher func- 
tions. When defined in this way, they are not ordered 
according to increasing sequency but are what is termed 
binary ordered. Appendix A shows this method of defining 
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Walsh functions and derives algorithms for converting from 
one method of ordering to the other. The original sequency 
ordering of Walsh seems to be best suited to the purposes of 
communications engineering. 

Another property of Walsh functions can be seen from 
their internal symmetries. A product of two Walsh functions, 
if they are both even or both odd about will be even. If 
one is odd and one is even, their product will be odd. This 
is also true with the symmetries about etc. Since this 

product function is completely described by its symmetry 
properties about the points 2 i=l,2,3,..., it must be 

concluded that this product is also a Walsh function. More- 
over, the index of the product is the modulo 2 sum of the 
indices of the two factors. Thus: 

W (k , t ) • W (m , t ) = W(k^m,t) 
where ^ indicates addition modulo 2. 
i.e. W(2, t) -W(3, t) = WCIO^, t) -WCll^, t) 

= 

= W(0l2,t) 

= W(l,t) 

Since the reciprocal of a Walsh function is the same function, 

WCk, t) = 1/WCk, t) 

the Walsh functions form a closed set under multiplication 
or division. 

A useful property of discrete Walsh functions is that 

Wj^(j,k) = Wj^Ck,j), 

that is the matrix representation , Figure 4, is symmetric. 
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A Hademard matrix is an N x N matrix, each of whose ele- 
ments are +1 or -1 and such that the rows of the matrix are 
orthogonal to each other using the ordinary vector inner pro- 
duct* Since the discrete Walsh function representation con- 
forms to this definition, it is a symmetric Hadamard matrix. 

If H denotes the matrix, then: 

T T 

H*H = NI where H is H transpose 

N is the order and 

I is the identity matrix 
T 

but H is symmetric, so H = H , and therefore, HH = NI . This 
important property will be used in Section IV, The Walsh 
Transform . 



14 



HI. GENERATION OF WALSH FUNCTIONS 



Walsh functions can be generated in several different 
ways, all of which depend upon the mathematical properties of 
the functions as discussed in Section II. Figure 5 shows a 
hardware realization of a Walsh f unc tion generator designed 
by Harmuth [Ref. 9]. This generates V7alsh functions as pro- 
ducts of Rademacher functions as discussed in Appendix A. 

Swick [Ref. 22 and 5] showed that by using the properties 
of symmetry, a particular Walsh function can be written down 
directly from left to right without making use of any preced- 
ing function. This method is to expand the index of the 
desired function into binary. 

i.e. k = b b ,...b,,N=2’^, 
n n-1 1 ’ 

and let W(k,t) = 1 in the interval [0,1/N]. Then for j = n, 
n-1, ..., 1 if bj = 1(0) then W(k,t) is odd(even) about 2 ^ 
when it is considered as a function over the interval 
[0,2 . Figure 6 shows the generation of W(ll,t) by 

this method. Eleven in binary is 1011 and n = 4. Letting 
W(ll,t) = 1 in the interval [0,1/16], then b^ = 1 indicates 
an odd function about 1/16 on the interval [0,1/8]; b^ - 0 
indicates an even function about 1/8 over the interval 
[0,1/4] ; b 2 - 1 indicates an odd function about 1/4 oyer 
[0,1/2]; and b^ = 1 indicates an odd function over the entire 
interval [0,1] . 

Peterson, [Ref. 18], devised a method similar to Swicks in 
which the index is expanded into reflected binary (Grey code) . 
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i.e. k “ ^...g^, WCkjt) = 1 in the interval IO,l/Nj 

and then for j ~ n, n-l,...,l; WCk>t) in the interval 
[2 2 is equal to (-1) • vf (k, t ) in the interval 

[0,2 Referring again to Figure 6 for the generation of 

W(ll,t), and using the algorithm from Appendix A for conver-- 
sion from binary to reflected binary, 11 in reflected binary 
is 1110, Letting W(ll,t) = 1 in the interval [0,1/16], then 
(-1)^^ = -1 and W(ll,t) in the interval [1/16,1/8] equals 
~W(ll,t) in the interval [0,1/16]. Similarly, W(ll,t) in 
11/8,1/4] equals -W(ll,t) in [0,1/8]; W(ll,t), 1/4 t 1/2 
equals -W(ll,t) for 0 t 1/2; and the function from t = 1/2 
to t = 1 is equal to W(ll,t) over [0,1/2]. 

It should be noted that by using Swick’s method but ex- 
panding the index in reflected binary or by- using Peterson’s 
method with the index expanded in binary, the Walsh functions 
generated are in binary order instead of sequency order. 

Figures 7 and 8 show hardware versions of a fast Walsh 
transform algorithm which will be discussed in further detail 
in Section IV. A single pulse input into the device of 
Figure 7 or a pulse shifted through the input register of 
Figure 8, will produce as an output the Walsh functions in- 
stead of the sequency spectral components. 

Computer program 1 utilizes a set of algorithms [Ref.ll, 
l2, and 13J to form a Hadamard matrix of Walsh functions in 
either binary or sequency order. These algorithms compute 
the value of the Walsh function at each point without refer- 
ence to previous points or previous functions. This is a 
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relatively slow method of function generation since it does 
not take advantage of the symmetry properties of the Walsh 
f unc t ions . 

Computer program 2 also generates a Hadamard matrix in 
sequency order using an algorithm based on Peterson’s method 
of Walsh function generation. 
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IV. THE WALSH TRANSFORM 



It was shown in Section II that a function can be ex- 
pressed in a series based on Walsh functions analogous to a 
Fourier series. In this series, a set of coefficients, 

{a^^}, represented the sequency spectrum of the given function. 
The discrete or sampled form of the Walsh transpose became: 

N-1 

a, = 1/N Z f (jx) -W„(k, j) (IV-1) 

j=0 



If the samples of f(jx) are arranged in a column matrix. 



f (0) 

f( t) 
f (2t) 



f [ (N-1) T ] 

and premultiplied by the Hadamard representation of the Walsh 



functions, equation (IV-1) is realized in matrix form as: 



W = 1/N HF 



(IV-2) 



where W is a column matrix of the spectral coefficients. 
Because of this property, the finite Walsh transform is often 
called the Hadamard transform. 

From the properties of H as described in Section II, it 
can be readily seen that: 

HW = 1/N HHF = NI/N F = F ClV-3) 

or that with the exception of a constant multiplier, 1/N, the 
same procedure is used to obtain both the transforiu and the 
inverse transform . 
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Some of tKe properties of the finite Walsh transform 



. 15 J, 


are as follows ; 




if 


f CjT)^ 


—>wcf ) 


and 


gCjT)^ 


— "WCg) 



are transform pairs, then: 

(1) The transform is linear 

^ ‘ f ( j ) +h • g C j t) ^a • W (f ) +b • W ( g ) 

for real constants a and b, 

(2) The coefficient of index 0 is the sample mean of f(j) 

N-1 

a(0) = 1/N Z f(jT) 

Logical or dyadic convolution of two sequences f ( j ) and g(j) 
is defined as : 

N-1 

h(jT)= 1/N Z f (kT)g[ (jOk)T] (lV-4) 

k = 0 

where ^ indicates modulo 2 addition 

(3) 

h(jx)= f(j)6 g(j)^ ^W(f)-W(g) 

where 0 indicates logical convolution 
and (4) f ( jx) Gf ( j ^^WCf)^ 

This is the analog of the Wiener-Khinchin theorem of the 
frequency domain. The Walsh power spectrum is the finite 
Walsh transform of the logical autocorrelation of f(jx). 

Computer program 2 utilizes the Hadamaxd matrix multi- 
plication method to give both the transform or inverse 
transform of an input. This method is straight forward but 
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time requirements can be decreased considerably by using fast 
transform algorithms much like the fast Fourier transform. 

Several approaches exist for fast Walsh transform imple- 
mentation, One method described by Shanks [Ref, 21J parallels 
the derivation by Cooley and Tukey for the fast Fourier trans- 
form, but even faster methods are available [Ref. 2, 23, 

and 25] which make use of the internal symmetry properties 
of the Walsh functions. 

A useful method is closely associated with Peterson’s 
method of Walsh function generation. Instead of the reflected 
binary expansion of the index indicating whether the inter- 
val is repeated with or vjithout a sign change, the index 
indicates whether the interval is added or subtracted with 
the adjacent interval. For example, for the second spectral 
component of an eighth order system: 
f(jx) = f ^ 

^2 ~ ^011 binary) 

8 ^ ~ §2 ~ ~ ^ 

and a2 = 1/8 (f ^+f ^) - (f 3) - [ (f ^+f 3 ) - (f ^+f ^) ] 

t't I I ! f t 

83 82 83 ^3 ^2 ^3 

Figure 7 depicts a hardware realization of this type system 
for an eighth order spectrum. 

Using this or other fast Walsh transform algorithms 
reduces the number of operations required to Nlog^N real 
additions (and/or subtractions) as compared to Nlog^N complex 
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multiplications and Nlog 2 N complex additions as required by 
the fast Fourier transform algorithms. It is therefore much 
faster to go from the time to the sequency domain than from 
the time to the frequency domain. Also the inverse Walsh 
transform can be performed with the same hardware or software 
as the transform and is therefore much more economical if the 
cost is calculated in time, computer memory or hardware. 

Computer program 3 and Figure 8 depict software and hard- 
ware realization of another fast Walsh transform method. In 
this method, sums and differences of the sample values are 
formed according to a pattern. The sequency spectrum coeffi- 
cients are the output and in the hardware version, the se- 
quency corresponding to the coefficient can be found by trac- 
ing the most direct path from anyone of the sample input 
points to the desired output. When an addition is passed 
through, a zero is written down; when a subtraction is passed 
through, a one is written down starting at the higher and pro- 
ceeding to the lower digits. When the output terminal is 
reached, the digits written down are the reflected binary 
representation of the index of the coefficient. 

The software version, represented by subroutine FASWAL 
of computer program 3 requires the subroutine function CONVRT 
to convert the coefficients to the sequency order. These 
coefficients are in a reversed reflected binary order much 
as the discrete fast Fourier transform’s outputs are in a 
reversed binary order, [Ref. 8]. 
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To find the corresponding indicies as CONVRT does where 



WCm) = TCk) 

W(ra) is the Walsh coefficient in sequency order 

T(k) is the coefficient in reversed reflected 
binary order 

(1) expand m into binary 

m b b ^atab^ 
n n-1 1 



(2) convert to reflected binary 

” = SnSn-r-'^l 

(3) reverse order of digits 

(4) use this as the binary representation of k 



k - Sj_S2 



k 



n 




2 



n-p 



Figure 7 shows another version of this same fast trans- 
form algorithm. In this case, the input is applied serially 
and after N input samples, the output (in parallel) will be 
the Walsh transform or the inverse transform if the input is 
the sequency ordered spectral coefficients. Note that as 
for Figure 8, the output is in reversed reflected binary 
order. 

Either of these realizations have advantages when hard- 
ware implemented since the ordering of the output can be 
predetermined and hard-wired so the reordering is not neces- 
sary each time the system is used. Note also that either of 
these units can be used to generate Walsh functions. The one 



22 



in Figure 7 by putting a unit pulse into the input and the 
one in Figure 8 by shifting a unit pulse down through the 
input register. 
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V. 



DIGITAL FILTER CONSIDERATIONS 



One of the traditional methods of digital filtering in 
the frequency domain is by the use of the convolution theorem. 
That is, an input function is transformed into the frequency 
domain using either the Fourier, Laplace, or transform. 

This is multiplied by a weighting function, the transform of 
the impulse response of a desired filter, and the inverse 
transform is taken, yielding the desired output. The logical 
convolution theorem does not produce this result. 

Much has been written about the transition to and from 
the Walsh or sequency domain for the purpose of digital fil- 
tering but very little material can be found concerning what 
can be done while in the sequency domain to obtain the desired 
response from the filter in the time domain. 

It is possible to construct a filter with any desired 
sequency response. There is a rough correlation between se- 
quency and frequency responses of filters but only to the 
point that the higher sequencies contain more of the higher 
frequencies than the lower sequencies do. For example, low 
pass sequency filtering at a sequency cutoff of one-half the 
highest sequency, the sampling sequency, is equivalent to 
halving the sampling rate of the input function. 

To take advantage of the high speed and other economical 
properties of the Walsh functions, it would be desirable to 
be able to obtain a desired frequency response of a digital 
filter which operates in the sequency domain. 
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The first step in the investigation of this possibility 
will be to find the frequency spectrum of the discrete Walsh 
functions. (The frequency spectrum of the continuous Walsh 
functions is shown in Appendix B.) 

The Z-transform of a Walsh function can be written as: 

N-1 

Z[W^(k,j)] = E W„(k,j).z^ (V-1) 

^ i=0 

noting that for N = 1, 

Z[W^(0,0)] = 1 (V-2) 

and for N = 2, 

Z[W2(0,j)] = l+z“^ 

Z[W2(l,j)] = l-z“^ (V-3) 



the following recursive relationship is postulated: 

Z[Wj^(2k+p, j) ] = (V-4) 

p = 0,1 k = 0,1,2, . . . ,N-1 

j = 0,1,2, .. . ,N-1 N = 2,4,8, .. . 

This can be induced by the following argument for N a power 
of 2, say N = 2^, Expressing k of equation (V-4) in binary 
as : 



k=bb -b ^...b- 
n n-1 n-2 1 



CV-5) 



The binary representation of k caia be converted to reflected 
binary (see Appendix A) as; 



k« b b -.b ^...b^ 

2 n n-1 n-2 1 



b b ^ , 
n n-1 



(V-6) 



k 

8 



®n^n-l^n-2 
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Noting that, 





I2-k]. = b b , . . .b^O 


(V-7) 


and 




(V-8) 


then , 


U+2-J]2 = 


(V-9) 


and 


11+2- - Sn^n-l-'-Slh 


(V-10) 




, -r — ( 1 for b^ = 0 

where b^ = ^ 1 





0 for = 1 



From Peterson's method of Walsh function generation as 
discussed in Section III, the higher order function is com- 
posed of the lower order function over the interval [0,1/2] 
and (-1)^1 or (-1)^1, (for 2*j and 2’j+l, respectively), 
times the lower order function over the interval [1/2,1]. 
Since (-1)^ = (-1)^1 and (-1)'^^^ = (-1)^1, -equation (V-4) is 
established . 

The Z-transform of a Walsh function will therefore be of 
the form, 

Z[W^(k,j)] =(l+z"^) d+z"^) d+z"^) . . . d+z”^^^) (V-11) 

As can be seen from equations (V-4,7,8,9 and 10), the 
sequence of signs is determined by the reflected binary code 
of the index, k; that is. 



z[Wj^(k,j)] = JT [i+C-D'^z 

n 



(V-12) 



n 

r 



1,2,4,... ,N/2 



®[log2(N/n)-l] 



where g is the subscripted digit of 
the reflected binary representation 
of k. 
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i == 



evaluat ing , 



z = e 



1 , -xmwT 

- 1 + e — ;!5 

xwT 2 



T = sample period 
OJ = radian frequency 



imwT -irtUDTs -imwT 
= 2 (e-^^ e -7 ) e —7 



= 2 Co s (moJT ) e 



-xmcOT 



(V-13) 



letting X = ; f = 1 /x = sampling frequency 

^ X S 

s 

then , 



1+z 



~m/ 2 



= 2Cos(xm)e - — 
lOOT 2 

z = e 2 



(V-14) 



Similarly , 



1-z 



-m/2 



2Sin(^)e-fH + f 

z = e 2 



(V-15) 



Therefore the frequency spectrum of a discrete Walsh function 
is simply a product of a group of sine and cosine functions 
with a linear phase response and can be written down directly 
upon expansion of the index, k, into reflected binary. For 
W^(k,j), expanding k into reflected binary gives, 

k = gn®n-l‘*’®l ’ " ° log2(N) 
then the magnitude of the frequency spectral component is 

given as, 

|FlWj^(k, j)J I = 2 ’^lf^Cx)f^_j^( 2 x) . . .f ( 2 '^"^x) I (V- 16 ) 

f (x) =fCos(x) for gp = 0 
^ |^SinCx)forgp = l 

and the phase is given by, 

^^IW^(k,j)J = -(N-l)x+mlT/2 
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where 



n 

m - Z g 

p=i p 

For example, the frequency spectrum of would be, 

k = 14,. = OHIO. = 01001 

10 2 g 

N = 32, n = 5 

1 F [ W 32 (14 , j ) ] I = 2^ I Cos (x) Sin (2x) Cos (4x) Cos ( 8 x) Sin (16x) I 

and the phase is, 

) ] = - 31x + 2'j = - 31x + TT 

Figure 10 shows the amplitude of the frequency spectrum of 

the first eight Walsh functions of order 16 plotted on the 

interval [O^f/f . 5 } , Note that 0.5 f/f is the maximum or 

s s 

Nyquist frequency for digital filter applications. In 
general it is only necessary to plot the first N/2 spectrums, 
since by symmetry, the N/2 remaining spectrums, (Figure 11), 
can be obtained by reversing the f/fg axis of the lower order 
frequency s pec tr urns . 

One method often used for digital filtering in the fre- 
quency domain is to use digital resonators in the form of 
comb filters with zeros introduced to give the desired spec- 
trum response, A Walsh function resonator can be defined as 
a digital circuit whose pulse response is a Walsh function, 

A Walsh resonator can be constructed as shown in Figure 12. 
Here, the sign on each input to the N input summer is deter- 
mined by the sign of the particular Walsh function at that 
point, j, A reaonator is shown in Figure 13, 
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The z-transform of W^(k,j), equation (V-11) , leads to 
another and simpler realization of the Walsh resonator. This 
method, shown in Figure 14, uses cascaded sections of lower 
order filters. The resonator of this type is 

shown in Figure 15. This is the method which led to the 
development of the fast Walsh transform algorithm discussed 
in Section IV. The hardware realization of that algorithm 
shown in Figure 7 is simply a full set of N Walsh resonators. 

Referring again to Figures 10 and 11, it can be seen that 
various frequency responses can be obtained by cascading and 
paralleling various combinations of Walsh resonators. There 
is no method known that will give the classic filter frequency 
responses such as Butterworth, Chebychev, or elliptic using 
this method. A function minimization of the mean square error 
between a desired frequency response and the frequency res- 
ponse of cascaded/parallel Walsh resonators can give the 
necessary combination whose frequency response is* as close 
to the desired response as is possible with a given number of 
resonators. This method will lead to results comparable to 
that of using a digital comb filter and resonators in the 
frequency domain, [Ref. 8J . 

As an example, a filter is desired with a narrow band- 
width at approximately f/f = .25, using three Walsh resona- 

s 

tors. Using the W^^(7,k) resonator as a starting approxima- 
tion, it can be seen that the bandwidth can be decreased and 
sidelobe magnitudes decreased by cascading it with notch 

filters constructed from W.^(6,k) and W^.(9,k) resonators. 

Id 15 
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The notch filters are simply resonators whose output is sub- 
tracted from the input in a feed forward manner. This is 
made possible by the linear phase characteristics of the 
Walsh resonators. 

Figure 16 shows a block diagram of such a filter and 

Figure 17 shows the frequency response of the filter. The 

3db bandwidth is about .04f/f and the nearest sidelobe is 

s 

down approximately 16db from the main lobe. Neither of the 
diagrams takes into account the delay errors which would 
probably be introduced by such a system but these errors can 
be eliminated much in the same way as they are in frequency 
domain digital filters. Filters with higher Q’s and better 
sidelobe suppression can be obtained by using higher order 
Walsh resonators and/or more of them in the system. 
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VI. RESULTS AND CONCLUSIONS 



Many computer runs of both an on--line and off-'line nature 
using the Walsh transforms for digital filtering have been 
made with various types of inputs and filter responses. After 
this work, it was concluded that the use of Walsh functions 
is not the absolute answer to digital filtering or to the 
many other fields of application being investigated. However, 
they do appear to have definite applications to assist in 
overcoming certain problems. 

The areas, other than multiplexing [Ref. 4, 14, 15 and 
17], where greater benefits may be obtained as compared to 
the conventional methods appear to be where either the input 
or output function is of a discontinuous nature. One area 
where this has been put to u'se is in the field of image pro- 
cessing [Ref. 1, 3 and 19]. Here the input function, nor- 

mally two dimensional, may have noise bursts included in it 
which may be attenuated by low pass sequency filtering or may 
have low contrast areas which can be enhanced by high pass 
sequency filtering. In the first case, the input has discon- 
tinuities, the noise bursts; in the second, the output re- 
quires the presence of discontinuities, the image edges. It 
has been shown that digital image processing by multi-dimen- 
sional Walsh methods gives essentially equivalent results to 
Fourier methods but with the speed increase inherent in the 
sequency domain. 
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Image processing and the field of pattern recognition 
iRef . 6 J have much in common and again if the pattern to be 

processed is of a discontinuous form, it is believed that 
Walsh functions may again be superior to Fourier methods. 

Another signal which has characteristics that lend 
themselves to Walsh functions is one of the '‘infinitely’* 
clipped type. Infinitely clipped signals also only take on 
two values and can be represented by Walsh functions easily. 
The use of Walsh functions in this area, especially for 
application to infinitely clipped speech processors and 
vocoders should be investigated further. 

Walsh functions will probably gain even greater status 
in the fields of image processing and multiplexing but with 
the exception of very specialized applications, their use 
to filter sinusoids will probably remain quite limited. 
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APPENDIX A 



Walsh Functions as Products of Rad einacher Products 



The Rademacher functions can be defined as follows: 
R(0,t) 



R(l,t) = 





0^5 t^l 


lo. 


0 therwise 


[1, 




f" 


i-t^i 


VO, 


otherwise 



then 



R(n,t) = R(n-l,2t)+ R(n-l,2t-l) (A-1) 

n = 2,3,4,..., 

Each Rademacher function is a replica of the preceding func- 
tion with the sequency doubled. Referring to Figure 2 and 
Figure 3, the first 5 Rademacher functions are W(0,t), W(l,t), 
W(3,t), W(7,t), and W(15,t). That is, the Rademacher func- 
tions are the Walsh functions numbered 2^-1, n = 0,1,2,.... 
Defining a different method of ordering the Walsh functions, 
W(m,t)^ and expressing m in binary form, 

m = g^^n-l* • 

Then : 

n 

W(m, t)j^ = TT CA-2) 

3-1 



i . e . 



WC4.t)^= WCl002,t)j^ = R(3,t) 
W(5,t)^= W(10l2,t)j^ = R(3,t)'Iia,t) 
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Noting that W(4,t)^= W(7,t) and WC5,t)^= W(6,t), the func- 
tions WCin,t)^ are not in the sajne order as W(k,t). To find 
the index, m, in W(m,t)^ which corresponds to the index, k, 
in W(k,t), it is necessary to represent WCk,t) as the product 
of Rademacher functions, remembering that R(i,t)= W(2^-l,t), 
From the product rule, W (p , t ) • W (q , t) = W(p^q,t) and express- 
ing k in its binary digits: k = b b -b ^*..b- the desired 

^ y to ^ n-2 1 

relationship can be found* 

From (A-2 ) : 

n n 

j=l j=l 

but 2^ ^ in binary is of the form 111»***1 and k must be the 
modulo 2 sum of several factors of this type. This can be 
expressed as : 



b b 



n n-1 



• • -b = ^ g 



n n 

"V — 



n-l^n-1* • *^n-ie* ’ *e^l 



n-1 digits 



n digits 
Adding the right side gives, 

6„_i ® ) . . . (g^® . . . «g^) 



or. 



The re f o r e 






or 



g = b 
^n n 



Sn® S„-l- 



g 1 = b # b . 

'^n-1 n n-1 



and 
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0 



g. = b. <&b. ^ , b - = 

J J J-1 n+1 

Thus the binary representation of m , , is the 

reflected binary (Grey code) representation of 

That is, 

The following algorithms can be used to convert from binary 
to reflected binary or vice versa. 





= b . e 
J 


illustrated by 


b 1 

n n-1 


b 9 

n-2 


'^b 




n+1 ^n 


U - 

n-1 


■n ^n-1 


^n-2 


n+1 ^n 


^-1 



'j-i 



■j j+l’ n+1 




JL 






b b , 
n n-1 



^ 2 . ^ 



b3 b^ 



3 2 



n-2 



•> 2 ^ »1 



Figure 9 shows a set of discrete Walsh functions genera- 
ted as the product of Rademacher functions and left in 
binary order. 
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APPENDIX B 



Frequency Spectrum (Fourier Transform) 
of the Continuous Walsh Functions 

The Fourier transform, FCw), of a function is defined as, 

i - 



F(w) = / e ^^^fCt) dt 



therefore , 



F- (w) = / e ^^^W(k,t)dt 

0 



w = radian frequency 



and by the definition of W(k,t), 

^ -iwt. 



F (w)= / e (k , 2 t ) d t+ (-1 ) ^ / e (k , 2 t-1) dt 

^^0 0 



or 



1/2 Fj^(w/2) [l+(-l)^e ~] 



S imilar ly , 



^2k Fj^(w/2) [l-(-l)^e iy] 



Therefore , 



FqCw) 


= ^ (1 
iw 


-iw. 

-e 


F^ (w) 


= 1/21 


o “iw 


X 




w/2 




4i 


-iw , 




w 


2 ' 



> “iX 

’ 2 Sin(w/2) 



w 



-iw> 



2 

F 2 <w) Sin^(w/8) SinCw/4) 

F.Cw) = — Sin^Cw/8) CosCw/4) 

J w z 



By induction, a general form of Fj^(w) can be established as 
follows ; 
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expanding k in reflected binary, 





^ ■' Sn^n-l' ‘ ‘^1 


let 


n 

m ~ 1 g 

3=1 ^ 


then , 






2n+l(^^m 2 n+1^ 

' • e • Sxn (w/2 ) • 

w z 


n-l 





Sin^j (w/2^''’^) (w/2^'^^ 

j=l 




Fig. 1. 



The first 16 Harr Functions, 



X^i) (t) . 
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Fig. 3. The First 16 Walsh Functions, W(k,t). 
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Fig. A. Discrete Walsh Functions of Order 16 
(Sequency Ordered) 
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Fig. 5. Walsh Function Generator(as Rademacher Function 
Products) . 
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Fig . 9 . Discrete Walsh Functions of Order 16 
CBinary Ordered ) 
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Fig. 10. Frequency Spectrum of First 8 Discrete Walsh 
Functions, Wj^g(k,j). 
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Fig. 11. Frequency Spectrum of Second 8 Discrete Walsh 
Functions, Wj^g(k,j). 
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Fig. 12. Walsh Function Resonator. 
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Fig. 13. Walsh Resonator for W 22 (l^»j)* 
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Fig. 17. Frequency Response of Narrow Bandpass Filter 

Using Walsh Resonators. 
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COMPUTER PROGRAM 2 



Walsh Transform as Hadamard Matrix Product 
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